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(57) Abstract: A system for the compression and decompression of 
image files is provided. A library (12) of basic waveforms is produced 
by applying selected digital initialization codes to a chaotic system 
(10). Each basic waveform is in one-to-one correspondence with an 
initialization code. Aweighted sum of selected basec waveforms is 
used to approximate each slice of an image. The basic waveforms 
are then discarded and only the weighting factors and the correspond- 
ing initialization codes are stored in a compressed image file. When 
the compressed image file is decompressed for playback, the stored 
initialization codes are stripped out and applied U> a similar chaotic 
system to regemate the basic waveforms, which are recombined ac- 
cording to the stored weighting factors to produce an approximation 
of the original image slice. 
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METHOD AND APPARATUS 
FOR THE COMPRESSION AND DECOMPRESSION OF 
IMAGE FILES USING A CHAOTIC SYSTEM 

This application is a Continuation-In-Part of currently pending Short - Method 
and Apparatus for the Compression and Decompression of Audio Files Using A Chaotic 
System - application serial no. 09/597,101 filed June 20, 2000. 

FIELD OF THE INVENTION 

The present invention relates generally to a method and apparatus for the efficient 
compression and decompression of image files using a chaotic system. More specifically, it 
relates to a system for approximating an image file with basic waveforms produced by 
applying selected digital initialization codes to a chaotic system and further processing the 
initialization codes to produce a compressed image file. 

BACKGROUND OF THE INVENTION 

In general, a chaotic system is a dynamical system which has no periodicity and 
the final state of which depends so sensitively on the system's precise initial state that its 
time-dependent path is, in effect, long-term unpredictable even though it is deterministic. 

One approach to chaotic communication, Short, et al., Method and Apparatus for 
Secure Digital Cliaotic Communication. U.S. Pat. App. No. 09/436,910 ("Short I"), 
describes a chaotic system controlled by a transmitter/encoder and an identical chaotic 
system controlled by a receiver/decoder. Communication is divided into two steps: 
initialization and transmission. The initialization step uses a series of controls to drive the 
identical chaotic systems in the transmitter/encoder and receiver/decoder into the same 
periodic state. This is achieved by repeatedly sending a digital initialization code to each 
chaotic system, driving each of them onto a known periodic orbit and stabilizing the 
otherwise unstable periodic orbit. The necessary initialization code contains less than 16 
bits of information. The transmission step then uses a similar series of controls to steer the 
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trajectories of the periodic orbits to regions of space that are labeled 0 and 1, corresponding 
to the plain text of a digital message. 

Short, et al., Method and Apparatus for Compressed Chaotic Music Synthesis, U.S. 
Pat. No. 6,137,045 ("Short II"), describes the use of such an initialization step to produce 
and stabilize known periodic orbits on chaotic systems, which orbits are then converted into 
sounds that approximate traditional music notes. By sending a digital initialization code to 
a chaotic system, a periodic waveform can be produced that has a rich harmonic structure 
and sounds musical. The one-dimensional, periodic waveform needed for music 
applications is achieved by taking the x«, y-, or z-component (or a combination of them) of 
the periodic orbit over time as the chaotic system evolves. The periodic waveform 
represents an analog version of a sound, and by sampling the amplitude of the waveform 
over time, e.g., using audio standard PCM 16, one can produce a digital version of the 
sound. The harmonic structures of the periodic waveforms are sufficiently varied that they 
sound like a variety of musical instruments. 

Short, Method and Apparatus for the Compression And Decompression of Audio 
Files, U.S. Patent App. No. 09/597,101 ("Short EH") describes the creation of a library of 
basic waveforms associated with a chaotic system by applying selected digital initialization 
codes to the chaotic system. Each initialization code is in one-to-one correspondence with a 
specific basic waveform, allowing the use of the corresponding initialization code to 
represent the basic waveform. The basic waveforms are then used to approximate a section 
of audio file. 

The basic waveforms that are most closely related to the section of audio file are 
selected, and a weighted sum of the selected basic waveforms is used to approximate the 
section of audio file. Once a weighted sum is produced that approximates the section of 
audio file to a specified degree of accuracy, the basic waveforms can be discarded and only 
the weighting factors; the corresponding initialization codes; and certain frequency 
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information are stored in a compressed audio file. The compressed audio file may also 
contain other implementation-dependent information, e.g. header information defining 
sampling rates, format, etc. When the compressed audio file is decompressed for playback, 
the initialization codes are stripped out and used to regenerate the basic waveforms, which 
are recombined according to the weighting factors in the compressed audio file to 
reproduce an approximation of the original section of audio file. 

. The present invention is a system for compression and decompression of image 
files. An image file may exist in any one of a number of commercially available formats, 
e.g. grayscale format, "yuv" format, "rgb" format, or any of a number of other formats 
in general use. In the grayscale format, the gray level is the sole variable, and each image 
in the image file represents a 2-dimensional matrix in which each position carries 
information about the gray level, which is just the degree of darkness on a scale of a fixed 
number of possible shades of gray, scaling from white to black. In the "rgb" format, every 
position in the 2-dimensional matrix carries information about the red level, green level and 
blue level, which is just the degree of intensity on the color scale. In the "yuv" format, 
one of the dimensions is a gray scale level, and the remaining two dimensions represent 
color levels. 

The primary feature that separates an image file from time series data produced in 
an audio file is that the data in an image file comes in disconnected "slices," where the 
term slice denotes a single vertical or horizontal scan line on an analog. screen or a single 
vertical or horizontal line of pixels in a digital image. For example, if the digital image is 
1280 x 1024 pixels, there are 1280 rows, or slices, of 1024 pixels. Thus, the maximum 
slice length is externally imposed in an image application, and compression can be done on 
a slice of maximum length or on any portion thereof. 

The first step in image file compression is to decompose an image first into slices of 
maximum length or any portion therof desired. The process is simplest to picture in the 
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grayscale format, where the two-dimensional pixel matrix just has a single entry (the 
grayscale level) at each position in the matrix. In the "rgb" format, for example, it is best 
to picture the data in 3 separate two-dimensional pixel matrices. Each two-dimensional 
matrix would contain just the color level for a single color. Forming a slice from one of 
the matrices is simply a matter of extracting a single row or column at a time. The data on 
each slice is either the gray level at each position on the slice if it is in grayscale format; 
the red level, green level or blue level at each position on the slice if it is in "rgb" format; 
or the gray level, first color level , or second color level in the "yuv" format. 

The slice data differs from the time series data in an audio file in one important 
respect. Audio file data tends to be almost periodic on short time scales and oscillates 
around a zero. The slice data, which is a color level, often shows a definite trend, either 
increasing or decreasing over an extended span of pixels. It does not necessarily appear 
oscillatory and does not necessarily have the short-term periodic structure of chaotic 
waveforms. The solution to this problem can be achieved by taking the slice data and 
removing the trend line from the data to produce a detrended image slice. In the cases 
where there is a discontinuity in the trend of the data across the slice, one can break the 
slice up into a small number of shorter slices and remove the trend from the shorter slices. 
In one embodiment, the trend line may be replaced by a spline curve fit to the data or any 
other simple functional approximation of the large scale trends in the data. In another 
embodiment, the data on the slice is considered to be a one-dimensional collection of 
ordered data points, and a best-fit least squares regression line is calculated to fit the data. 
This best-fit line is the trend line, and once it is subtracted from the data, the residual 
difference, or detrended image slice, formed by subtracting the trend line from the image 
slice is oscillatory in nature. Trend line information describing the trend line is stored. The 
detrended image slice is now suitable for compression onto chaotic waveforms, following a 
procedure described below similar to that described in Short HI. 
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In summary, a library of basic waveforms associated with a chaotic system is 
produced, by applying selected digital initialization codes to the chaotic system. The basic 
wavefonns that can be produced with 16-bit initialization codes range from simple cases 
that resemble the sum of a few sine waves with an associated frequency spectrum 
containing only two or three harmonics, to extremely complex waveforms in which the 
number of significant harmonics is greater than 100. Importantly, the initialization codes 
are 16 bits regardless of whether the basic waveforms are simple or complex. By contrast, 
in a linear approach, one would expect the number of bits necessary to produce a waveform 
to be proportional to the number of harmonics in the waveform. The number of harmonics 
present in the wavefonns is directly tied to the complexity of the structure, and it is 
generally true that if there are many harmonics in a waveform, there is more fine structure 
present in the waveform. This makes it possible to match the rapid variation often present 
* in the detrended image slices and, further, since the spectral content of any sharp edges in a 
detrended image slice requires a high number of harmonics to reproduce the sharp edge, 
the fact that the chaotic waveforms have high harmonic content means that they are 
naturally suited to image reproduction. Equally importantly, each initialization code is in 
one-to-one correspondence with a specific basic waveform, allowing the use of the 
corresponding initialization code to represent the basic waveform. Then basic waveforms 
selected from the library are used to approximate a detrended image slice . 

The basic waveforms that are most closely related to the detrended image slice 
are selected, and all the selected basic waveforms and the detrended image slice are 
transformed to a proper frequency range. Then, a weighted sum of the selected basic 
waveforms is used to approximate the detrended image slice. Once a weighted sum is 
produced that approximates the detrended image slice to a specified degree of accuracy, the 
basic waveforms can be discarded. Only the corresponding initialization codes; the 
weighting factors, the trend line information, and certain phase and frequency information 
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described below are stored in a compressed image file. Once the detrended image slices 
from all the slices of an image file have been compressed, the processing can advance to 
the next image in the image file. The compressed image file may also contain other 
implementation-dependent information, e.g. header information defining aspect ratios, 
trend line specifications (e.g. slope and intercept) format, etc. When the compressed image 
file is decompressed for playback, the initialization codes are stripped out and used to 
regenerate the basic waveforms, which are transformed to the proper frequency range and 
recombined according to the weighting factors in the compressed image file to reproduce 
the detrended image slice. The trend line information is then read from the compressed 
image file and the trend across the original slice is then regenerated and added back to the 
detrended image slice. This reproduces an approximation of the original image slice. 

The compressed image file can be transmitted, or stored for later transmission, to 
an identical chaotic system for decompression at a remote location. In practice, the remote 
location does not need the compression part of the system and would only use the 
decompression part of the system if playback of the image file is all that is desired. 

A further degree of compression is often possible and desirable. After finding a 
suitable weighted sum of basic waveforms, the weighted sum can be examined and any 
waveforms that contribute less to the overall approximation than a specified threshold can 
be eliminated. When such waveforms are identified, the corresponding initialization codes 
can be removed from the compressed image file. Also, because the compression may be 
done on sequences of image, it is possible to look at the basic waveforms and the 
corresponding initialization codes to determine if there is a predictable pattern to the 
changes from image to image in the sequence . If such patterns are detected, further 
compression of the compressed image file can be achieved by storing only the requisite 
initialization code and information about the pattern of changes for subsequent images. 
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It is an object of the present invention to create compressed image files for 
distribution over the Internet. Compression ratios at better than 50-to-l may be possible, 
which will allow for the transmission of image files over the Internet with greatly improved 
download speed. Compression of grayscale images is the most problematic application for 
image compression because the human eye is extremely sensitive to variations in light/dark 
levels. Consequently, in standard compression of grayscale image files, the data is either 
uncompressed, compressed at a ratio of 2:1 or compressed at a higher level with the 
realization that the image will be greatly degraded. Using the chaotic compression 
technique, it has been possible to compress 8-bit grayscale images by approximately 10:1, 
which would translate to approximately 20:1 for 16-bit grayscale images. 

It is yet another object of the present invention to create compressed image files that 
are encrypted. For example, image files compressed with the present invention are naturally 
encrypted in accordance with Short I. In order to be able to decompress properly a 
compressed image file, it is necessary to have the proper chaotic decompressor. These 
decompressors can be distributed freely or to a group of registered users, thus allowing for 
some control over the distribution and reproduction of the compressed image files. Even 
greater control of the uses of the compressed image files can be achieved by incorporating a 
secondary layer of a secure chaotic distribution channel, using the technology described in 
Short I, to encode the digital bits of the compressed image files before transmitting them to a 
user. Since registered users can be given unique chaotic decoders, it will be possible to place 
a "security wrapper" around the compressed image files, so that only a registered user will be 
able to access it. It will also be possible to structure the security wrapper so that a movie file 
can be played a given number of times after paying a fee. 
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SUMMARY OF THE INVENTION 

A new system for the compression and decompression of image files is provided. 
An image file may exist in any one of a number of common formats. An image from the 
image file is then decomposed into "slices," a single scan line on an analog screen or a 
single line of pixels in a digital image. The maximum length of the slice is externally 
imposed by the size of the image, but a shorter slice may be selected. The data on the slice 
is either the gray level at each position or the color level at each position. 

The data on the slice is then considered as a one-dimensional collection of 
ordered data points, and the slices can be made suitable for compression with chaotic 
waveforms by a simple detrending step. A trend line is calculated and trend line 
information describing the trend line is stored. The trend line is then removed from the 
slice to produce a detrended image slice. In one embodiment, the detrending step, includes 
calculating a best-fit least squares regression line to fit the data. This best-fit line is the 
trend line, and once it is subtracted from the data, the residual data, or detrended image 
slice, is oscillatory in nature. The detrended image slice is suitable for approximation by 
basic waveforms. Also, more complicated general trends can be removed by using spline 
functions or other simple functions to approximate the overall trend line. 

A library of basic waveforms is produced by applying selected digital 
initialization codes to a chaotic system. Each initialization code produces and stabilizes an 
otherwise unstable periodic orbit on the chaotic system. The basic waveforms needed are 
achieved by taking the x-, y-, or z- component (or a combination of them) of the periodic 
orbits over time. The basic waveforms that can be produced with 16-bit initialization codes 
range from simple to complex, and each basic waveform is in one-to-one correspondence 
with an initialization code. 
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The basic waveforms in the library that are most closely related to the detrended 
image slice to be compressed are selected and all the selected basic waveforms and the 
detrended image slice are transformed to a proper frequency range. Then, a weighted sum 
of the selected basic waveforms is used to approximate the detrended image slice. Once 
such a weighted sum is produced to approximate the detrended image slice to a specified 
degree of accuracy, the basic waveforms can be discarded and only the corresponding 
initialization codes, the weighting factors, the trend line information, and certain phase and 
frequency information are stored in a compressed image file. Once all the slices of an 
image have been compressed, the processing can advance to the next image in the image 
file. When the compressed image file is decompressed for playback, the stored 
initialization codes are stripped out and used to regenerate the basic waveforms, which are 
transformed to the proper frequency range and combined according to the stored weighting 
factors to reproduce the detrended image slice. The trend line information is then used to 
regenerate the trend line which is added to the detrended image slice to produce an 
approximation of the original image slice. 

A further degree of compression may be achieved if, after finding a suitable 
weighted sum of basic waveforms, any basic waveforms may be eliminated. Also, because 
the compression may be done on sequences of image, it is possible to look at the basic 
waveforms and the corresponding initialization codes to determine if there is a predictable 
pattern to the changes from image to image in the sequence . If such patterns are detected, 
further compression of the compressed image file can be achieved by storing only the 
requisite initialization codes and information about the pattern of changes for subsequent 
images. 

The foregoing and other objects, features and advantages of the present invention 
will be apparent from the following detailed description of preferred embodiments of the 
invention as illustrated in the accompanying drawings. 
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IN THE DRAWINGS 

Fig. 1 is a block diagram of a compression and decompression system for image 
files according to an embodiment of the present invention. 

Fig. 2 is a flow chart showing the steps in general in a compression system for 
image files according to an embodiment of the present invention. 

Fig. 3 is a flow chart showing in greater detail the creation of a library of basic 
waveforms according to an embodiment of the present invention. 

Fig. 4 is a plot of the double scroll oscillator resulting from the given differential 
equations and parameters. 

Fig. 5 is a plot of the function r(x) for twelve loops around the double scroll 

oscillator. 

Fig. 6 is a plot of the periodic orbit of the double scroll oscillator resulting from 
a 5-bit initialization code (01011). 

Fig. 7 is a grayscale image file. 

Fig. 8 is a plot of the data for a single slice of the grayscale image file shown in 

Fig. 7. 

Fig. 9 is a plot of the slice shown in Fig. 8 after detrending. 
Fig. 10 is a plot of a first approximation of the slice shown in Fig. 8 using 
chaotic waveforms. 

Fig. 11 is a plot of all the slices of the grayscale image shown in Fig. 7 using 
chaotic waveforms. 
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DETAILED DESCRIPTION OF THE INVENTION 

A block diagram of an embodiment of the present invention is contained in Fig. 1 . 
The system 1 for compression and decompression of image files comprises an image file 2 
stored in any one of a number of common formats and an image decomposer 4 for 
decomposing an image from the image file into "slices," single scan lines on an analog 
screen or single rows of pixels in a digital image. The maximum length of the slice is 
externally imposed by the size of the image but multiple shorter slices comprising the 
maximum length may be selected. 

The slice of the image is then processed by a slice data detrender 6, in which a trend 
line is calculated and trend line information describing the trend line is stored in storage 
device 20. The trend line is subtracted from the slice data, and the residual difference, or 
detrended image slice, is held. 

A compression controller 8 applies selected digital initialization codes to a selected 
chaotic system 10. Each initialization code produces a basic waveform that is stored in a 
library 12 with its corresponding initialization code. The detrended image slice from an 
image slice to be compressed is analyzed in a waveform comparator 14, which then selects 
the basic waveforms and their corresponding initialization codes in the library 12 that are 
most closely related to the detrended image slice to be compressed and transforms all the 
selected basic waveforms and the detrended image slice to a proper frequency range. A 
waveform weighter 13 then generates a weighted sum of the selected basic waveforms to 
approximate the detrended image slice and the weighting factors necessary to produce the 
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weighted sum. The basic waveforms are then discarded and the corresponding initialization 
codes, certain phase and frequency information and the weighting factors, are stored in the 
storage device 20. The stored trend line information, initialization codes, phase and 
frequency information and weighting factors comprise a compressed image file. 

For decompression and playback, the compressed image file is transmitted to a 
remote decompression controller 22, which strips out the stored initialization codes and 
applies them to a chaotic system 24 that is identical to the chaotic system 10 used in 
compression. Each initialization code produces a basic waveform that is sent to a 
waveform combiner 26. The decompression controller also sends the stored phase and 
frequency information and weighting factors from the compressed image files to the 
waveform combiner26. The basic waveforms are transferred to the proper frequency range 
and combined in the waveform combiner 26 according to the weighting factors to reproduce 
the original detrended image slice The detrended image slice is then processed by a slice 
data retriever 28 in which the trend line is added to the detrended image slice to produce an 
approximation of the original image slice. 

A flowchart of a preferred embodiment of the present invention, in general, for 
compression of image files is shown in Fig. 2. The process begins within image file 30 in 
any one of a number of common formats. An image from the image file is then 
decomposed in step 32 into "slices," a single vertical or horizontal scan line on an analog 
screen or a single vertical or horizontal line of pixels in a digital image. The maximum 
length of the slice is externally imposed by the size of the image but multiple shorter slices 
comprising the maximum length may be used. The data on the slice is either the gray level 
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at each position in grayscale format or the color level, at each position in any otherformat. 

In step 34, the data on the image slice is then considered as a one-dimensional 
collection of ordered data points. The slice data, which is either a gray level or a color 
level, often shows a definite trend, either increasing or decreasing over an extended span. It 
does not necessarily appear oscillatory and does not necessarily have the short-term 
periodic structure of chaotic waveforms. The solution to this problem can be achieved by 
taking the slice data and removing the trend line from the data to produce a detrended 
image slice. In the cases where there is a discontinuity in the trend of the data across the 
slice, one can break the slice into a small number of shorter slices and remove the trend 
from each shorter slice. In one embodiment, the trend line may be replaced by a spline 
curve fit to the data or any other simple functional approximation of the large scale trends 
in the data. In another embodiment, the data on the slice is considered to be a one- 
dimensional collection of ordered data points, and a best-fit least squares regression line is 
calculated to fit the data. This best-fit line is the trend line, and once it is subtracted from 
the data, the residual difference, or detrended image slice, formed by subtracting the trend 
line from the image slice is oscillatory in nature. Trend line information describing the 
trend line is stored at Step 35 as part of the compressed image file. The detrended image 
slice is now suitable for compression onto chaotic waveforms. 

The present invention uses digital initialization codes to drive a chaotic system onto 
periodic orbits and to stabilize the otherwise unstable orbits. Each periodic orbit then 
produces basic waveforms, and the set of basic waveforms ranges from those that are 
slowly varying over their period to those that exhibit rapid variation. The wide range of 
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variability results from the fact that the waveforms contain harmonics that number from just 
one or two to cases where there are more than 100 harmonics. Consequently, even the 
rapid variation in subtle shading of an image can be reproduced by the chaotic waveforms, 
and sharp transitions are readily reproduced because the chaotic waveforms have high 
harmonic content. 

Thus, the process continues with step 36 in which a library of basic waveforms and 
corresponding initialization codes is compiled as described in detail below. The library 
contains all of the basic waveforms and corresponding initialization codes for a particular 
chaotic system. In addition, key reference information about the waveforms can be stored 
efficiently in a catalog file. The information in the library can be static for a given 
embodiment. In most applications, the catalog file contains all relevant information and can 
be retained while the waveforms can be discarded to save storage space. 

Fig. 3 is a flow chart showing in greater detail the creation of the library of basic 
waveforms and corresponding initialization codes for a preferred embodiment. The first 
step 60 is choosing a chaotic system, to be driven onto periodic orbits to produce the basic 
waveforms. In a preferred embodiment, the chaotic system is a double-scroll oscillator [S. 
Hayes, C. Grebogi, and E. Ott, Communicating with Chaos, Phys, Rev. Lett. 70, 3031 
(1993)], described by the differential equations 



Clv Ci =G(Vc2 -v C i)-g(v C i) 
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C2v a = G(v C i - Vc2) + i L 

where 

mjv, if -B p £V*B p ; 

g(v)= mo(v + BpJ-m^p, ifv<s-B p ; 
mo(v - B p ) + m^p, if v;>B p 

The attractor that results from a numerical simulation using the parameters CI = 1/9, C2 
= 1, L = 1/7, G = 0.7, /Wq = -0.5, m l = -0.8, and B p = 1 has two lobes, each of 
which surrounds an unstable fixed point, as shown in Fig. 4. 

Because of the chaotic nature of this oscillator's dynamics, it is possible to take 
advantage of sensitive dependence on initial conditions by carefully choosing small 
perturbations to direct trajectories around each of the loops of the oscillator. This ability 
makes it possible, through the use of an initialization code, to drive the chaotic system onto 
a periodic orbit that is used to produce a basic waveform. 

There are a number of means to control the chaotic oscillator. In a preferred 
embodiment, a Poincare surface of section is defined on each lobe by intersecting the 
attractor with the half planes i L = ±GF, |v cl | <;F, where F =B p (mo- m^G+nio). When 
a trajectory intersects one of these sections, the corresponding bit can be recorded. Then, a 
function r(x) is defined, which takes any point on either section and returns the future 
symbolic sequence for trajectories passing through that point. If l u 1 2 , 1 3 , ... represent the 
lobes that are visited on the attractor (so li is either a 0 or a 1), and the future evolution of a 
given point Xo is such that Xq - 1„ 1 2 , 1 3 , 1 N for some number N of loops around the 
attractor, then the function r(x) is chosen to map Xq to an associated binary fraction, so r( Xq 
) =0.1i 1 2 1 3 ... 1 N , where this represents a binary decimal (base 2). Then, when r(x) is 
calculated for every point on the cross-section, the future evolution of any point on the 
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cross-section is known for N iterations. The resulting function is shown in Fig. 5, where 
r(x) has been calculated for 12 loops around the attractor. 

Control of the trajectory can be used, as it is here, for initialization of the chaotic 
system and also for transmission of a message. Control of the trajectory begins when it 
passes through one of the sections, say at Xq. The value of r(Xo) yields the future symbolic 
sequence followed by the current trajectory for Sloops. For the transmission of a 
message, if a different symbol in the Nth position of the message sequence is desired, r(x) 
can be searched for the nearest point on the section that will produce the desired symbolic 
sequence. The trajectory can be perturbed to this new point, and it continues to its next 
encounter with a surface. This procedure can be repeated as many times as is desirable. 

The calculation of r(x) in a preferred embodiment was done discretely by 
dividing up each of the cross-sections into 2001 partitions ("bins") and calculating the 
future evolution of the central point in the partition for up to 12 loops around the lobes. As 
an example, controls were applied so that effects of a perturbation to a trajectory would be 
evident after only 5 loops around the attractor. In addition to recording r(x), a matrix M 
was constructed that contains the coordinates for the central points in the bins, as well as 
instructions concerning the controls at these points. These instructions simply tell how far 
to perturb the system when it is necessary to apply a control. For example, at an 
intersection of the trajectory with a cross-section, if r(Xo) indicates that the trajectory will 
trace out the sequence 10001, and sequence 10000 is desired, then a search is made for the 
nearest bin to Xq that will give this sequence, and this information is placed in M. (If the 
nearest bin is not unique, then there must be an agreement about which bin to take, for 
example, the bin farthest from the center of the loop.) Because the new starting point after 
a perturbation has a future evolution sequence that differs from the sequence followed by Xo 
by at most the last bit, only two options need be considered at each intersection, control or 
no control. In an analog hardware implementation of the preferred embodiment, the 
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perturbations are applied using voltage changes or current surges. In a software 
implementation of the preferred embodiment, the control matrix M would be stored along 
with the software computing the chaotic dynamics so that when a control perturbation is 
required, the information would be read from M. 

A further improvement involves the use of microcontrols. For a preferred 
embodiment in software, each time a trajectory of the chaotic system passes through a 
cross-section, the simulation is backed-up one time step, and the roles of time and space are 
reversed in the Runge-Kutta solver so that the trajectory can be integrated exactly onto the 
cross-section without any interpolation. Then, at each intersection where no control is 
applied, the trajectory is reset so that it starts at the central point of whatever bin it is in. 
This resetting process can be considered the imposition of microcontrols. It removes any 
accumulation of round-off error and minimizes the effects of sensitive dependence on initial 
conditions. It also has the effect of restricting the dynamics of the chaotic attractor to a 
finite subset of the full chaotic attractor although the dynamics still visit the full phase 
space. These restrictions can be relaxed by calculating r(x) and M to greater precision at 
the outset. 

As also shown on Fig. 3, the next step 62 in creating the library of initialization 
codes and basic waveforms is the imposition of an initialization code on the chaotic system. 
The initialization code drives the chaotic system onto a periodic orbit and stabilizes the 
otherwise unstable periodic orbit. More specifically, the chaotic system is driven onto a 
periodic orbit by sending it a repeating code. Different repeating codes lead to different 
periodic orbits. For a large class of repeating codes, the periodic orbit reached is 
dependent only on the code segment that is repeated, and not on the initial state of the 
chaotic system (although the time to get on the periodic orbit can vary depending on the 
initial state). Consequently, it is possible to send an initialization code that drives the 
chaotic system onto a known periodic orbit. For embodiments in software, one can also 
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choose a fixed initial condition, which has the effect of making more of the initialization 
codes usable. 

These special repeating codes lead to unique periodic orbits for all initial states, 
so that there is a one-to-one association between a repeating code and a periodic orbit; 
However, for some repeating codes, the periodic orbits themselves change as the initial 
state of the chaotic system changes. Consequently, repeating codes can be divided into two 
classes, initializing codes and non-initializing codes. The length of each periodic orbit is an 
integer multiple of the length of the repeating code. This is natural, since periodicity is 
attained only when both the current position on the cross-section as well as the current 
position in the repeating code is the same as at some previous time. To guarantee that the 
chaotic system is on the desired periodic orbit, it is sufficient that the period of the orbit is 
exactly the length of the smallest repeated segment of the initializing code. 

The number of initializing codes has been compared with the number of bits used 
in the initialization code, and it appears that the number of initializing codes grows 
exponentially. This is a promising result, since it means that there are many periodic orbits 
from which to choose. As an example, the compressed initializing code 01011 was 
repeated for the double-scroll oscillator of a preferred embodiment. The chaotic dynamics 
in Fig. 4 are driven onto the periodic orbit shown in Fig. 6, which periodic orbit is 
stabilized by the control code. 

As is further shown on Fig. 3, the next step 64 in creating the library is 
generating a basic waveform, i.e. a one-dimensional, periodic waveform, for each periodic 
orbit by taking the x-, y-, or z-component (or a combination of them) of the periodic orbit 
over time. By sampling the amplitude of the waveform over time, e.g. using audio 
standard PCM 16, one can produce a digital version. These basic waveforms can be highly 
complex and have strong harmonic structure. The basic waveforms can have more than 
100 strong harmonics for some initialization codes, and an important factor that contributes 
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to the performance of the compression technology is the fact that complex basic waveforms 
with 100 strong harmonics can be produced with the same number of bits in the 
initialization code as simpler basic waveforms with only a few harmonics. This is 
indicative of the potential for compression inherent in this system since complex basic 
waveforms are produced as easily as simple basic waveforms. This is only possible 
because of the nonlinear chaotic nature of the dynamical system. 

The chaotic system can be implemented entirely in software. The chaotic system 
in such an implementation is defined by a set of differential equations governing the chaotic 
dynamics, e.g, the double scroll equations described above. The software utilizes an 
algorithm to simulate the evolution of the differential equations, e.g., the fourth order 
Runge-Kutta algorithm. 

The chaotic system can also be implemented in hardware. The chaotic system is 
still defined by a set of differential equations, but these equations are then used to develop 
an electrical circuit that will generate the same chaotic dynamics. The procedure for 
conversion of a differential equation into an equivalent circuit is well-known and can be 
accomplished with analog electronics, microcontrollers, embedded CPU's, digital signal 
processing (DSP) chips, or field programmable gate arrays (FPGA), as well as other 
devices known to one skilled in the art, configured with the proper feedbacks. The control 
information is stored in a memory device, and controls are applied by increasing voltage or 
inducing small current surges in the circuit. 

Returning to the flow chart in Fig. 2, at step 38, a detrended image slice to be 
compressed is chosen and compared to the basic waveforms in the library. The comparison 
may be effected by extracting key reference information from the detrended image slice and 
correlating it with the information in the catalog file. Those basic waveforms that are most 
similar, based on selected criteria, to the detrended image slice are then selected and used 
to build an approximation of the detrended image slice. 
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There are many approaches that can be employed to compare the basic 
waveforms and the detrended image slice, including a comparison of numbers of zero 
crossings; number and relative power of harmonics in the frequency spectrum; a projection 
onto each basic waveform; and geometric comparisons in phase space. The technique 
chosen is dependent upon the specific application under consideration, but in a preferred 
embodiment, it has been effective to encapsulate the basic waveform information in a 
vector that describes the (normalized) magnitudes of the strongest harmonics. 

A comparator matrix is created to contain the (normalized) spectral peaks 
information for each basic waveform in the library. Then, for the detrended image slice, a 
comparison is made between the spectrum of the detrended image slice, and the spectrum 
of the basic waveforms. In the encapsulated form, the basic waveform that is the closest 
match can be found merely by taking inner products between the detrended image slice 
vector and the basic waveform vectors of spectral peaks. The best-match basic waveform 
is selected as the first basis function, along with other close matches and basic waveforms 
that closely matched the parts of the spectrum that were not fit by the first basis function. 
In different applications, there may be a variety of approaches to choosing the basic 
waveforms to keep as basis functions, but the general approach is to project the detrended 
image slice onto the library of basic waveforms. Finally, in some applications it is 
unnecessary or undesirable to keep a library of basic waveforms; in these cases the basic 
waveforms are recreated as needed by applying the corresponding initialization codes to the 
chaotic system. 

After the appropriate basic waveforms have been selected, one can begin to 
approximate the detrended image slice. In step 40, all of the selected basic waveforms and 
the detrended image slice are transformed to a proper frequency range, either the detrended 
image slice range or a fixed reference range, in which a comparison can be made. For 
example, they can be resampled so that they are in a fixed frequency range. This can be 
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accomplished through standard resampling techniques. Typically, the resampling is done to 
obtain better resolution of the signals (i.e., upsampling), so no information is lost in the 
process. 

Once the detrended image slice and all the basic waveforms are in the proper 
frequency range, an approximation, in step 42, is possible. A necessary component is to 
align the basic waveforms properly with the waveforms of the detrended image slice (i.e., 
adjust the phase), as well as to determine the proper amplification factor or weighting factor, 
(i.e., adjust the amplitude). There are a number of ways this can be done, but the general 
approach involves a weighted sum of the chosen basic waveforms. The weighting factors 
are found by minimizing some error criterion or cost function, and will typically involve 
something equivalent to a least-squares fit to the detrended image slice sample. A 
particularly efficient approach used in a preferred embodiment is to take all of the basic 
waveforms and split them into a complexified pair of complex conjugate waveforms. This 
can be accomplished by taking a basic waveform, f u calculating the fast Fourier transform 
of the basic waveform, call it F l9 then splitting the transform in the frequency domain into 
positive and negative frequency components F lpos , F lDeg . The positive and negative 
frequency components are then transformed separately back to the time domain by using the 
inverse Fourier transform, resulting in a pair of complex conjugate waveforms that vary in 
the time domain, f lpos and f lneg , where f lpos = (f lneg )*. The key benefit of the splitting and 
complexification of the waveforms is that when the complex conjugate waveforms are 
added together with any complex conjugate pair of weighting factors, the result is a real 
waveform in the time domain, so if a and a* are the coefficients, then af lpos + a* f lneg is 
a real ftinction, and if the factors are identically 1 the original function f t is reproduced 
(adjusted to have zero mean). Further, by choosing a and a* properly, the phase of the 
waveform can be automatically adjusted, although the net effect includes a phase shift of 
the harmonics of the waveform, it has been effective in one embodiment. In practice, the 
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phase and amplitude adjustments can be achieved at once for all of the basic waveforms 
simply by doing a least squares fit to the detrended image slice using the complexified pairs 
of complex conjugate waveforms derived from the basic waveforms. The weighting 
functions from the least squares fit are multiplied by the associated waveforms and summed 
to form the approximation to the detrended image slice. This approximation can then be 
tested to determine if the fit is sufficiently good in step 42, and if further improvement is 
necessary the process can be iterated 44. 

The next stage of the compression, step 46, involves examining the 
approximation and determining if some of the basic waveforms used are unnecessary for 
achieving a good fit. Unnecessary basic waveforms can be eliminated to improve the 
compression. After removing unnecessary basic waveforms, the initialization codes for the 
remaining basic waveforms, the weighting factors, and the phase and frequency information 
can be stored in step 48 as part of the compressed image file. 

In step 50, , the sequence of images can be examined and when there is some 
consistency to the waveforms and control codes used or when an overall trend can be 
identified between images in the sequence, then further compression results when the first 
image is stored in the usual compressed format, along with information which encapsulates 
the sequence-change information along with any correction bits which are deemed 
necessary. Finally, the compressed image file 52 comprising the stored trend line 
information, the stored initialization codes, the stored phase and frequency information and 
the stored weighting factors is produced. The compressed image file can be stored and 
transmitted using all storage and transmission means available for digital files. 

A preferred embodiment of the present invention for decompression of a 
compressed image file involves reversing the steps taken to compress the image file. The 
stored initialization codes are stripped out and used to regenerate the basic waveforms, 
which are transformed to the proper frequency range and combined according to the stored 
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weighting factors to reproduce the detrended image slice. The trend line information is then 
used to regenerate the trend line which is added to the detrended image slice to produce an 
approximation of the original image slice. 

Another preferred embodiment of the present invention is now described in more 
detail, but there are many variations that produce equivalent results. Fig. 7 shows an image 
file composed of 150 x 1024 pixels which is a grayscale image of mountaintops and clouds. 
Fig. 8 shows the data from a single slice, where the horizontal axis corresponds ^ the pixel 
number and the vertical axis represents the grayscale level. Fig. 9 shows the slice after 
detrending, and Fig. 10 shows the approximation of the slice using the chaotic waveforms. 
When all of the slices have been represented in the chaotic waveforms and the trend lines 
have been added back, the reproduced image appears in Fig. 11. In general, the detrended 
image slice length is an adjustable parameter, and in some implementations it would even 
vary during the compression of a single image file. 

The first step in the process is to analyze the detrended image slice to determine 
the frequency content of the detrended image slice. This is done by calculating the fast 
Fourier transform ("FFT M ) of the slice and then taking the magnitude of the complex 
Fourier coefficients. The spectrum of coefficients is then searched for peaks, and the peaks 
are further organized into harmonic groupings. At the first iteration, the harmonic group 
associated with the maximum signal power is extracted. This is done by determining the 
frequency of the maximum spectral peak, and then extracting any peaks that are integer 
multiples of the maximum spectral peak. These peaks are then stored in a vector, v peajcs , to 
give the first harmonic grouping. (In practice, further refinement of the harmonic grouping 
is necessary, since the fundamental or root frequency of a harmonic grouping is often not 
the maximum peak. Rather, the root frequency would be an integer subharmonic of the 
maximum frequency, so if F^ is the frequency with the maximum power, harmonic 
groups of peaks based on a root frequency of F max /2, then F^/3, etc. would be extracted, 
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and then the first harmonic group to be considered would be that one which captures the 
greatest power in the peaks.) The vector containing the first harmonic group is taken to be 
of length 64 in this embodiment, and, although other implementations may set different 
lengths, it is necessary to allow for a large number of harmonics in order to capture the 
complexity of the basic waveforms. The goal at the next stage of the compression is to find 
basic waveforms that have similar harmonic structure to the detrended image slice in 
* question. 

The second step in the process is to find basic waveforms in the library of basic 
waveforms that exhibit similar spectral characteristics. This process is rather simple 
because the library is established ahead of time and each basic waveform in the library has 
already been analyzed to determine its harmonic structure. Consequently, for each 
waveform in the library, a vector of harmonic peaks has been extracted, call these vectors 
p h where i varies over all waveforms and assume that 64 peaks have again been taken. 
These vectors are first normalized to have unit length and are then placed in a matrix, M, 
that has 64 columns and as many rows as there are waveforms (up to around 26,000 in one 
embodiment). In order to keep track of which waveform is associated with which row in 
M, an index table is set up that contains the control code associated with each row in M. 
Then, to find the closest match to the music vector, v peaks , we can calculate the matrix 
product Xp rojection = Mv peaks and find the maximum value in Xp rojectioil . The row that gives the 
maximum value corresponds to the basic waveform that matches the detrended image slice 
most closely. We can then extract the corresponding initialization code from the index 
table, and we can generate the desired basic waveform or, if the basic waveforms have 
been stored digitally, we can just load it from the library of basic waveforms. In many 
instances, it is worthwhile to choose more than one close match to the detrended image 
slice , since a weighted sum of several basic waveforms is necessary to produce a suitable 
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match; these can be taken by selecting the largest values in x pr0jecti0I1 , and taking the 
associated basic waveforms indicated in the index table. 

The third step in the process requires adjustment of the period and phase of the 
basic waveforms. Since the basic waveforms are periodic, the adjustment process can be 
completed without introducing any errors into the basic waveforms. This can be done 
entirely in the frequency domain, so the transformations are made to the FFT of the basic 
waveforms, using standard techniques known in signal processing. The basic waveforms 
will be adjusted so that the root frequencies of the basic waveforms match the root 
frequencies of the detrended image slice. To do this, the FFT of the basic waveform is 
padded with zeros to a length that corresponds to the length of the FFT of the detrended 
image slice. The complex amplitude of the root frequency of the basic waveform is then 
shifted up to the root frequency of the detrended image slice, and the remaining harmonics 
of the root frequency of the basic waveform are shifted up to corresponding multiples of the 
root frequency of the detrended image slice (the vacated positions are filled with zeros). 
After the shifting, if the inverse FFT is calculated, the basic waveforms will all have the 
same root frequency as the detrended image slice; however, the phase of the basic 
waveforms may not match the phase of the detrended image slice. So, before calculating 
the inverse FFT, the phase of the chaotic waveforms is adjusted so that the phase of the 
basic waveform matches the phase of the detrended image slice. 

The phase adjustment is achieved by multiplying the complex Fourier amplitudes 
in the FFT by an appropriate phase factor of the form e i9 where 9 is chosen to produce the 
correct phase for the peak corresponding to the maximum peak in the detrended image 
slice, and the phases of the other spectral peaks are adjusted to produce an overall phase 
shift of the basic waveform. Note that by multiplying by a phase factor, the overall 
spectrum of the signal is unchanged. Different embodiments of the technology use slightly 
different approaches to the phase adjustment, e.g., one can adjust the phase through 
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filtering, or the phase adjustment can be calculated by a minimization principle designed to 
minimize the difference between the detrended image slice and the basic waveform, or by 
calculating the cross-correlation between the basic waveforms and the detrended image 
slice. All approaches give roughly equivalent results. 

The fourth step in the process is to compute the weighting factors for the sum of 
basic waveforms that produces the closest match to the detrended image slice. This 
calculation is done using a least-squares criterion to minimize the residual error between the 
detrended image slice and the fitted (sum of) basic waveforms. In the event that the first 
group of basic waveforms does not produce a close enough match to the detrended image 
slice, the process is iterated until the desired representation is reached. The compression 
results from the fact that the compressed chaotic version requires only information about 
the initialization codes, weighting factors, phase and frequency and trend lines for a few 
basic waveforms, rather than 8-bit or 16-bit amplitude information for each of the data 
points in the detrended image slice. 



WO 02/065386 



27 



PCT/US02/00397 



What is claimed is: 

1 . A method of compressing an image file comprising: 

choosing an image file to be compressed and decomposing it into slices; 
finding a trend line for each slice and calculating trend line information 
describing the trend line; 

calculating for each slice a detrended image slice, by subtracting from each slice 
its trend line and storing the trend line information describing the trend line; 
choosing a chaotic system; 

applying selected digital initialization codes to the chaotic system such that each 
initialization code produces a periodic orbit and stabilizes the otherwise unstable periodic . 
orbit; 

generating a basic waveform for each periodic orbit such that the basic waveform 
is in a one-to-one correspondence to the initialization code for the periodic orbit; 

selecting basic waveforms to be used with each detrended image slice and 
storing their corresponding initialization codes; 

transforming the detrended image slice and the selected basic waveforms to a 
proper frequency range and storing frequency information describing the transformation; 

calculating weighting factors to create a weighted sum of the selected basic 
waveforms to approximate each detrended image slice and storing the weighting factors; 
and 

combining the stored trend line information, the stored initialization codes, the 



WO 02/065386 



28 



PCT/US02/00397 



stored frequency information and the stored weighting factors for each detrended image 
slice to comprise a compressed image file. 

2. The method of compressing an image file of claim 1 further comprising the steps 
of removing from the weighted sum of the selected basic waveforms any selected basic 
waveforms not deemed necessary to approximate sufficiently well the image file and of 
removing the corresponding stored initialized codes. 

3. . The method of compressing an image file of claim 1 further comprising the step of 
identifying trends over sections of compressed image file and replacing the stored weighting 
factors for the sections of compressed image file by a suitable function. 

4. A method of compressing a series of image files, comprising repeating the method 
of compressing an image file of claim 1 for each image file and replacing the stored 
weighting factors for each compressed image file by a suitable function. 

5. A system of compressing an image file comprising: 

means for choosing an image file to be compressed and decomposing it into slices; 

means for finding a trend line for each slice and calculating trend line information 
describing the trend line; 

means for calculating for each slice a detrended image slice, by subtracting from each 
slice its trend line and storing the trend line information describing the trend line; 

means for choosing a chaotic system; 

means for applying.selected digital initialization codes to the chaotic system such that 
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each initialization code produces a periodic orbit and stabilizes the otherwise unstable 
periodic orbit; 

means for generating a basic waveform for each periodic orbit such that the basic 
waveform is in a one-to-one correspondence to the initialization code for the periodic orbit; 

means for selecting basic waveforms to be used with each detrended image slice and 
storing their corresponding initialization codes; 

means for transforming the detrended image slice and the selected basic waveforms to 
a proper frequency range and storing frequency information describing the transformation; 

means for calculating weighting factors to create a weighted sum of the selected basic 
waveforms to approximate each detrended image slice and storing the weighting factors; and 

means for combining the stored trend line information, the stored initialization codes, 
the stored frequency information and the stored weighting factors for each detrended image 
slice to comprise a compressed image file. 

6. The means for compressing an image file of claim 5 further comprising the means 

for removing from the weighted sum of the selected basic waveforms any selected basic 
waveforms not deemed necessary to approximate sufficiently well the image file and the 
means for removing the corresponding stored initialized codes. 

7. The means for compressing an image file of claim 5 further comprising the means for 
identifying trends over sections of compressed image file and the means for replacing the 
stored weighting factors for the sections of compressed audio file by a suitable function. 
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8. A system for compressing an image file comprising: 
a chaotic system; 

a compression controller to apply selected digital initialization codes to the chaotic 
system to drive in onto periodic orbits and to produce a basic waveform for each periodic 
orbit that is in a one-to-one correspondence with the initialization code for the periodic, orbit; 

an image decomposer to decompose an image to be compressed into slices; 

a slice data detrender to calculate for each slice a detrended image slice by subtracting 
from each slice its trend line and to store the trend line information; 

a waveform comparator to select the basic waveforms to be used with each detrended 
image slice and to store their corresponding initialization codes; 

a waveform weighter (i) to transform the detrended image slice and the selected basic 
waveforms to a proper frequency range and to store frequency information describing the 
transformation and (ii) to calculate weighting factors to create a weighted sum of the selected 
basic waveforms to approximate each detrended image slice and to store the weighting 
factors; and 

a storage device to combine the stored trend line information, the stored initialization 
codes, the stored frequency information and the stored weighting factors for each detrended 
image slice to comprise a compressed image file. 

9. A method of decompressing a compressed image file produced according to the 
method of claim 1 comprising: 

choosing a compressed image file; 

stripping stored initialization codes out of the compressed image file and applying the 
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stored initialization codes to a chaotic system substantially the same as the chaotic system 
used in producing the compressed image file to produce the corresponding basic waveforms; 

stripping the stored frequency information out of the compressed image file and using 
the stored frequency information to transfer the basic waveform to the proper frequency 
range; and 

combining the basic waveforms according to the stored weighting factors to produce a 
detrended image slice; 

stripping the trend line information out of the compressed image file and using the 
trend line information to regenerate a trend line to add to the detrended image slice to 
produce an approximation of an original image slice. 

10. A system of decompressing a compressed image file produced according to the 
method of claim 1 comprising: 

means for choosing a compressed image file; 

means for stripping stored initialization codes out of the compressed image file and 
applying the stored initialization codes to a chaotic system substantially the same as the 
chaotic system used in producing the compressed image file to produce the corresponding 
basic waveforms; 

means for stripping the stored frequency information out of the compressed image file 
and using the stored frequency information to transfer the basic waveform to the proper 
frequency range; and 

means for combining the basic waveforms according to the stored weighting factors to 
produce a detrended image slice; 
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Fig. 7- Original Image 




100 200 . 300 400 500 600 700 800 900 



Fig.l\- Compressed Image 




100 200 300 400 500 600 700 800 900 1000 



SUBSTITUTE SHEET (RULE 26) 



WO 02/065386 



8/9 



PCT/US02/00397 



Fig.V- Original Image Slice 
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